EXISTENCE AND STABILITY OF STANDING PULSES IN NEURAL 
NETWORKS: I. EXISTENCE 
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Abstract. We consider the existence of standing pulse solutions of a neural network integro- 
differcntial equation. These pulses are bistable with the zero state and may be an analogue for short 
term memory in the brain. The network consists of a single-layer of neurons synaptically connected 
by lateral inhibition. Our work extends the classic Amari result by considering a non-saturating 
gain function. We consider a specific connectivity function where the existence conditions for single- 
pulses can be reduced to the solution of an algebraic system. In addition to the two localized pulse 
solutions found by Amari, we find that three or more pulses can coexist. We also show the existence 
of nonconvex "dimpled" pulses and double pulses. We map out the pulse shapes and maximum firing 
rates for different connection weights and gain functions. 
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1. Introduction. The temporary storage of information in the brain for short 
periods of time is called working memory [S] . It is known that the firing activity of 
certain neurons in the cortex are correlated with working memory states but it is not 
known what neural mechanisms are responsible for maintaining the persistent neural 
activity [251 1281 [70] . Experiments find that a specific set of neurons become activated 
by a memory cue. They fire at a rate above their background levels while the memory 
is being held and then return to baseline levels after the memory is extinguished. 
When the neurons are active their firing rates are low compared to their maximal 
possible rates. Cortical neurons are generally not intrinsically bistable and do not fire 
unless given an input that is above a threshold jTH I47L ■ It has been suggested 
that recurrent excitatory inputs in a network could be responsible for maintaining 
neural activity observed during memories PSI 1^ ISTl IT71 ISSl 1^ 1701 17^ ITIIMI HI] . 
The persistent activity is bistable with the background state. To match experimental 
data, a memory network must have the ability to maintain persistent activity in a 
selected subset of the neurons while keeping the firing rates low compared to their 
possible maximum. 

Mathematically, this question has been probed by examining the existence and 
stability of localized persistent stationary solutions of neural network equations 
CniEniEIlEIlEZIESlElCHI- These locahzed states have been dubbed 'bump at- 
tractors' 021 ^2 IS COl El ■ In a one dimensional network they have also been 
called standing pulses |2(J[ 157] . While these simple networks do not capture all of the 
biophysical features of cortical circuits they do capture the qualitative behavior of 
working memory. 



The coarse-grained averaged activity of a neural network can be described by 
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where u{x,t) is the synaptic input to neurons located at position x G (—00, cx)) at 
time i > 0, and it represents the level of excitation or amount of input to a neural 
element. The connection function w{x) determines the connections between neurons. 
The nonnegative and monotonically non-decreasing gain function /[m], denotes the 
firing rate at x at time t. We can set the synaptic decay time t to unity without loss 
of generality. 

In his classic work, Amari considered with a 'Mexican Hat' connection 
function (i.e. excitation locally and inhibition distally). While this is not biologically 
realistic for a single layer of neurons, it has been argued that networks of combined 
excitatory and inhibitory neurons with biophysically plausible connections can effec- 
tively mimic a Mexican Hat under certain conditions |2(JI I37L IS7] . Amari also made 
the assumption that f[u\ is the Heaviside function. This approximation made 
analytically tractable and he was able to find a host of solutions one of them being 
localized stable pulses that are bistable with zero activity. Kishimoto and Amari [321 
later showed these solutions also existed for a smooth sigmoidal gain function that 
saturated quickly. 

Later work considered two populations [MIEZI, various connectivity functions JSl 
El ESI I and two dimensions jHEl^J- However, all used either the Heaviside gain func- 
tion or a saturating sigmoidal gain function implying that neurons start to fire when 
their inputs exceed threshold and saturate to their maximum rate quickly. However, 
in the brain persistently active neurons fire at rates far below their saturated maxi- 
mum jl2l 1131 1^ 1(1911717 ) . How a network can maintain persistent activity at low firing 
rates is not fully understood [Tni[T31ETl|El|lHl|iniEIlEniCn|- 

The problem of persistent activity at low firing rates cannot be addressed with a 
quickly saturating gain function. To circumvent this limitation, we use a nonsaturat- 
ing piecewise-linear gain function with a jump i.e. /3 = (see Fig. 12.2(1 having the 
form 



When the gain a is zero, ((1.2|l becomes the Heaviside function scaled by (i. We note 
that others have considered piecewise linear gain functions but without the jump \J\ 
|3Slin7|. In these cases, persistent activity is not possible unless the threshold is set to 
zero and the gain to unity where a multi-stable "line attractor" is possible j67j . 

In this paper we show the existence of isolated convex standing pulse solutions 
(single-pulses) of (11.1(1 . We consider a single one dimensional layer of neurons. Al- 
though, this configuration is a major simplification, it has been shown that such 
networks exhibit features present in more realistic architectures. We investigate how 
the pulse solutions change when parameters of the gain function and the connection 
function change. We demonstrate the coexistence of two single-pulse solutions as seen 
by Amari [S|, and give conditions where more than two pulse solutions can coexist. 
We also show the existence of nonconvex "dimple-pulse" solutions and double-pulse 
solutions. We derive the stability criteria for stable pulses in an accompanying pa- 



2. Neural network equations. We study a neural network 1(1.1(1 with lateral- 
inhibition or Mexican Hat type connection function w{x) for which excitatory connec- 
tions dominate for proximal neurons and inhibitory connections dominate for distal 
neurons. In general, w{x) satisfies the following six properties. 
1. w{x) is symmetric, i.e. it;(— a;) = w{x), 



(1.2) 




U > Ut 
U <Ut 



per 1231 . 
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2. w{x) > on an interval (— a;o, xq), and w{—Xq) — w{xq) — 0, 

3. w{x) is decreasing on {0,xq]; 

4. w{x) < on (— oo, —xq) U (xq, oo); 

5. w(x) is continuous on 3?, and w{x) is integrable on 3?; 

6. w{x) has a unique minimum Xm on 3?^ such that Xm > xq, and w{x) is 
strictly increasing on (xm,oo). 

For concreteness, we consider the connection function given by 

(2.1) «;(a;) = Ae~'^l="l -e-l^l 

where a > 1, and A > 1 guarantee that w{x) obeys properties 1-6. An example 
of H2.1|l is shown in Fig. 12.11 This connection function is of the lateral inhibition or 
Mexican Hat class. Perhaps, given the cusp at zero it should be called a "Wizard 
Hat" function. 



u 



Fig. 2.1. Connection function with A — 2.8, B = 1, a = 2.6, b — 1. 

. . iTTTT, In A Ina^ 

For connection function H2.1|) . Xq = and x„i — . The area of 'w(x) 

a — 1 a — 1 

above and below the x-axis represents the net excitation and inhibition in the network 

respectively. The total area of H2.1|l is 2(-^ — 1). The amount of excitation and 

inhibition depends on the ratio of A to a. If yl > a, i.e. 2(^ — 1) > 0, excitation 

dominates in the network and if 2(-^ — 1) < 0, inhibition dominates. In the balanced 

case, A = a, i.e. 2(^ - 1) = 0. 

The gain function (|1.2|) can be written as 

(2.2) f[u] = [a{u-uj,)+(3]e{u-ur) 

where Q{u — Uj,) is the Heaviside function such that 



(2.3) e(w-ur) 



1 if M > 

otherwise 




Fig. 2.2. Piecewise-linear gain function. 



The gain function H2.2|) does not saturate with a positive slope a. Without loss of 
generality, we set /? = 1. The gain function 1)2. 2|l turns into the Heaviside function 
when a = ( See Fig. lT^ . 

A stationary solution of satisfies the equilibrium equation 

/oc 
w{x^y)f[u{y)]dy. 
-OO 

An example of a working memory state can be seen by considering constant solutions 
of (|2.4|1 . For u{x) — vP , the integral equation becomes 

/oo 
w{y)dy 
-oo 

Using 1)2. the constant solution satisfies 

(2.6) u" = «;"/K]- 

where = 2 (A/a — 1). From H2.6|l . we immediately see that u° = is a solution. 
In fact, zero is a solution of (|2.4|) for any positive threshold Ut and any values of 
parameters a, A, and a. 

Inserting gain function (|2.2|) into H2.6|l gives 

(2.7) wO = u;0(a(u"-M^) + l) 

The existence of constant solutions can be deduced graphically (see Fig. Non- 
trivial constant solutions {vP > 0) require > which means that A/a > 1. Thus 
only for net excitatory connections are nontrivial constant solutions possible. A sim- 
ple stability calculation shows that q < 1 is necessary for stability. Condition (|2.7|l 
shows that for ut < and a < 1, there is a single stable solution. If > and 
a > there can be three solutions (see Fig. I2.3|l . Two of the solutions, = and 
> Ut are stable. The third solution at — ut is unstable. For this parameter 
set, the network exhibits working memory-like behavior. The network is stable in 
the background state ~ 0. A transient input from a memory cue can switch the 
network into the stable > ut state which represents the memory. This is a state of 
persistent activity that is sustained by positive feedback. The state can be switched 
off to zero by another transient input when it is no longer needed. The next section 
will examine spatially localized pulses that have the same memory property. 




3. Single-pulse solutions. We prove the existence and determine the proper- 
ties of locaHzed stationary persistent states which we call single-pulses. We consider 
single-pulse solutions of H2.4|l that satisfy the following: 

Definition 3.1. Single-pulse solution: 

{> Ut if a; e {—XtjXt), x^ > 
— Uj'j' if X — X ^ X — X 'J' 
< Ut otherwise 

such that {u, u' , u" , u'") —> (0, 0, 0, 0) exponentially fast as x ^ ±cxd and u, u' £ L^(5R). 
u and u' are bounded and continuous on 5R. u" , u'" , and u"" are continuous every- 
where except at X = -^iXt and hounded everywhere on 5R. u{x) is symmetric with 
u"(0) < 0; u(0) is the maximum between —Xt and Xt ( Fig. 

We note that there also exist pulses where u"(0) > 0, which implies u(0) is no 
longer the maximum of the pulse. We call this solution a dimple-pulse. The theorem 
below gives a range for which there is no single-pulse solution. 

Theorem 3.2. For fixed a, A and j3 — 1, there is no single-pulse solution if both 

a , 2A 
a < — — and > — are true. 

Proof. Substituting the exponential connection function l|2.1l) and gain function 
(12. 2|) into the integral equation H2.4|l gives 

/•oo 

(3.1) u{x)= (Ae-'^l=^-^l-e-l^-^l)[a(u(y)-u^) + l]e(M-u^)dy. 



Suppose there is a single-pulse solution as defined above when both a < — — and 
2A 

Uj. > — are satisfied. For a single pulse to exist 
a 

/•oo 

u(0)= / {Ae-^^y^ -e-^y^)[a{u{y)-Ur) + l]Q{u-u^)dy 
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(Ae-"l^l - e~l^l)[a(u(y) - u^) + l]dy 

'XT 
'XT 



where u{x) > ut is continuous on / := [—Xt,Xt]- Ae is integrable on / and 
Ae-°-\v\ > for all a; e /. By the Mean Value Theorem for Integrals, 3 c° G / s.t. 



u(0) < (au{c°) - auT + I) Ae-^^y^dy 

J —XT 

(3.2) < aPu{c") + (1 - auT)P 

- I I 2.4 

where P — Ae "^'"^'dy — — . If aP < 1 and (1 — uut) < are both true, then 

m(0) < u(c°), c E I. However, this cannot be true because u(0) is the maximum of 

a , , 1 2A 

u(x) on 5R. From aP < 1, we get a < ■—. From (1 — auy) < 0, it^ > — > — • 

2A a a 

a 2A 

Therefore, there is no single-pulse when both a < — - and Ut > — are both true. 

ZJi a 

In other words if the gain is too low or the threshold too high, there cannot be a 
single-pulse. □ 

3.1. Strategy to construct a single-pulse solution. The general approach 
to studying integral equation 12.4|l is to derive an associated differential equation 
whose solutions are also solutions of the integral equation. We derive the differential 
equation by using the Fourier transform 

/•OO 

F[g{x)] - / g{x)e^-dx 



where g £ and s e 5R, with the inverse Fourier transform 

For our conditions on u{x) and w(a;), an application of the Fourier transform to 
(|2.4(l is well-defined and turns the convolution into a point-wise product 

(3.3) F[u] ^ F[w]F[f[u]]. 

Computing F[w] in H3.3|l gives 

,^ r.r 1 {2aA + 2as'^A-2a'^ -23"^) 
(3-4) Flu] = , „ ^ ir^-P / • 

Multiplying both sides of (|3.4|) by the denominator of the right hand side and using 
the linear property of the Fourier Transform with the identities F[u"] = —s'^F[u] and 
F[u ] ~ s^F[u] gives 

(3.5) F[u"" - (a^ + l)it" + a^u\ = F\l(aA - a^)/] -|- 2(aA - \)F\s^ !\. 
By the definitions of u(x) and /[u], 

F{u" - (a^ + + a^u\ 
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and 

F[2{aA~a^)f] 

are in L\^). 

Integrating F[s'^f] by parts yields 

F[s'f] 

s'^e''''f[u{x)]dx 



-OO 

XT 



s 



XT 

^d^f[u{x)] 



XT '^•^^ 



-dx. 



Note that f[u{x)] = outside of {-Xt,Xt) and F[s^f] e L^{^). 

Applying the inverse Fourier transform to H3.5|l gives a fourth order ordinary 
differential equation 

(3.6) u"" - (a^ + l)u" + a^u = 2{aA - a^)f[u{x)] + 

d'fHx)] 



2{aA - 1) ^f[u{xT)]A'{x) + /'[u(x-)]u'(x,)A(a;) - 
where 

A'{x) = S'{x - Xt) + S'{x + Xt) 

and 

A(a;) = d{x — Xt) + S{x + Xt). 
Here 5{x) and S'{x) are defined as |2SI 

/"OO /"OO 

<5(x) = / e^'^^dx, 5'{x)^isl e''"=dx. 



If u(a;) is a solution of 1)3. 6|) where H3.3I) - (|3.5|) hold, then u{x) is also a solution of 

We construct a single-pulse solution as in Fig. l3.1l bv decomposing ODE H3.6() into 
two linear differential equations: 

//// d^fful 

(3.7) u - (a^ + l)u" + a'^u = 2a(A-a)f(u) - 2(aA - 1)— if m > Ut (region I) 

dx'' 

(3.8) ii"" - (a^ + + a^u = 0, if w < m^, (region II and III) 

We label the solution of (|3.6|l on regions I, II and III, ui{x) by uu{x) and uiii{x) 
respectively. The solutions ui{x), uii(x) and uiii(x) must be connected together at 
—Xt and Xt to get a continuous and smooth u(x) on 3?. Mi(a;) and uii{x) are connected 
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u 




at Xj- with five matching conditions: 



(3.9) 


UiiXj.) 


= Ut 






(3.10) 


uu{xt) 


— Urp 






(3.11) 


u[{xt) 


— Ujj(Xt) 






(3.12) 


u'Kxt) 


= Ujj(Xt) — 




\)!{u{x^)) 


(3.13) 


u'l'ix^) 


= Ujj (Xt) ~ 


2{aA- 


l)/'(ii(a;^))u'(x^) 



Conditions H3.9|l - H3.11|l are given by the continuity of u{x) and v! (x). (|3.13|) is obtained 
by integrating (|3.6|l over a small neighborhood of Xt ■ H3.12|l is obtained by integrating 
(13. 61) twice, first with respect to a:, then over a small neighborhood of Xt- u"{x) and 
u"'(x) are discontinuous at Xr, i.e. there are jumps in u"{xt) and u"'{xt)- Since u{x) 
is symmetric, similar matching conditions apply to ui{x) and uiii{x) at —Xj,. 

In region II, the solution for a single pulse that satisfies the boundary conditions 

is 

(3.14) un{x) ^ Ee-'''' + Fe^^ E,Fedi. 
By symmetry, the solution in region III is 

(3.15) um{x) ^ Ee"'' + Fe"" , E,F€^. 

d'^f[u(x)] 

In region I, substituting f[u(x)] = a(u — Uj-) + 1 and 7^ = au"(x) into 

()3.7() gives 

(3.16) u"" - (a^ + 1 - 2a(ayl - l))u" + (a^ - 2aa{A - a))u = 2a(yl - a)(l - auj.) 
The eigenvalues of H3.16|l are Wi, —uji, 0^2, where 

(3.17) ujI^R + S 

(3.18) ul^R-S 

with 

(3.19) ^^(a^ + l-2a(aA-l))^ 
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(3.20) 
and 

(3.21) A = (a^ + 1 - 2a{aA - l))^ - 4(0^ - 2aa{A - a)). 

Imposing symmetry and u'{Q) — 0, the general solution of ODE p.lGfl can be written 
in the form: 

(3.22) ui{x) = C(e"i^ + e""!^) + D(e"^^ + 6""=^^) + Uo 
where 

2{A- a){l3 - uut) 



a - 2a{A - a) 



for X G (— Xt, Xt), Xt G C, Z? e C, and ui{x) € 3?. 

The single-pulse solutions of H3.5|l are found by matching u/, w//, and u/// across 
and —Xt using the matching conditions (|3.9() - H3.10|l . We investigate the existence 
and shape of single-pulse solutions as we change the gain and connection function. 
For simplicity, we call Xt the width of a pulse although it is actually the half width. 
The height of a single-pulse is u(0). The firing rate of the pulse is given by f[u]. 

3.2. Solutions for the Amari case (a = 0). Amari found conditions for 
which single-pulse solutions exist for (|2.4() with general Mexican Hat connectivity and 
the Hcaviside gain function 3 . Here, we revisit the Amari case for the exponential 
connection function H2.1|l . When a = and (3 — 1, the gain function l|2.2|l becomes 

(|3.7|) . The eigenvalues H3.17|) and H3.18|l become simple and the solutions (|3.22|) and 
(|XTH) are 



the Heaviside function 0(u) and the term 2{aA— 1) ^ ^ does not exist in ODE 



(3.23) ui{x) = C(e''^ + e""^) -t- D(e^ + e"^) + Uq, 

(3.24) Unix) = £;e-"^ -f Fe"^, 

respectively. Applying conditions H3.9|l - 13.13|l to H3.23I) and (|3.24|) yields the system 

(3.25) £;e"""^ + Fe""^ = Ut 

(3.26) (7(6""^ + e"""^) + L»(e"^ -I- e""^) + ^'^^ ^ "^^ = ut 

a 

(3.27) aC(e""^ - e"""^) + i3(e"^ - e""^) = -aFe"""^ - Fe""^ 

(3.28) a^C(e""^ e"""^) + D(e"^ e""^) = a^Fe"""^ + Fe~"^ - 2(ayl - l)/3 

(3.29) a^C(e°"^ - e"""^) + i3(e"^ - e""^) = -a^Fe"""^ - Fe""^ 

The system H3.25II - H3.29|l is linear in the coefficients C, D, E, and F which can be 
solved in terms of Xt'- 

C = --e""^^ 
a 

D = e-'-"^ 

A 

E = -(e'^^r - e-°^^) 
F = -(e^^-e"^^) 
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^From these coefficients we arrive at the following proposition for single-pulse solu- 
tions. 

Proposition 3.3. There are two pulse solutions when Ut < J^^'^^^^^"" w{x)dx 

and ( 1) < Ut for A > a and < Uj, for A < a . 

a 

Proof Substituting E and F into (or C and D into 1^1^ ). gives an 

existence condition for a single-pulse: ^(xt) = Ut, where 

(3.30) $(x) = ^(l-e-2''^)- (l-e-2-). 

We term <^{x) the "existence function". Two examples are shown in Figs. IT^ and 
13.41 where the curve <^{x) crosses u^ twice, implying that there are two single-pulse 
solutions. Since 

^, . A ^ { <Q iiA<a { Figure lO) 
x^oo ^ ' a \>OifA>a (FigureEU ' 

the lower bound of Ut that supports two pulses is if A < a and the lower bound of 

Urp that guarantees two pulses is 1 when A > a. 

a 

The upper bound on threshold u-j. that supports two pulse solutions is the maxi- 
mum of <I>(x). Solving 

dx 

InA ^, ^ , . 

gives x = — -. Thus $ reaches its maximum at 

^ 2(a-l) 

(3.31) ^(x) = -(1 - e""^) - (1 - e"^) = / w{x)dx 

a Jo 

proving the proposition. □ 

Proposition 13 . 31 does not immediately imply that there are two single-pulses be- 
cause for a small threshold there can exist a dimple-pulse fFig 13.51 1 In Fig. 13.41 as 
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Fig. 3.3. Existence function $(a;) when A < a with a = 0, A = 2.6, a = 3. 

lim <l>(x) = 1 = —0.1333. ^(x) gives the range of thresholds Ut that supports two 

X — 'oo a 

single-pulse solutions. Example: at Ut ~ 0.2, <l>(a;) shows that we have a single-pulse solution 
1 with width x\,; the second single-pulse solution s is narrower and has width x^. 




X 



X ' 1 x'' 2 3 



Fig. 3.4. Existence function ^{x) when A > a. a = 0, A — 2.8, a = 2.6, 
lim ${x) — 1 = 0.07692. Example: atur ~ 0.3, ^{x) shows that there is a wide single- 

X — ^00 Oi 

pulse solution 1 with width x\. = 0.68633 and a narrower single-pulse solution s with width 
x^ = 0.12985. P is the transition point where single-pulse 1 changes into a dimple-pulse d. 
At the transition, =0.15672 and x^ = 1.24379. 

Ut is lowered, P is the transition point where u" = and single-pulse 1 transforms 
into the dimple-pulse d. The small single-pulse s always remains a single-pulse. The 
transition point P is identified by following m"(0) as a function of Ut using the contin- 
uation program AUTO. In the accompanying paper we compute the stability of these 
solutions. In agreement with Amari T we find that the large pulse is stable and the 
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small pulse is unstable. Additionally, we find that dimple pulse solutions can also be 
stable. 

3.3. Solutions for the general case. For the general case of a ^ 0, the com- 
plex eigenvalues cji, —uji, uj2, —^2 given by H3.17|l and (|3.18|) will change form for 
different parameter values. The transition points for the eigenvalues are given by the 
relative signs of functions R (|3.19|) . S (|3.20|l and A H3.21|l . There are three cases: 
both eigenvalues loi^2 are real, both are complex or both are imaginary. 

We consider the transitions when a is changed for fixed a and A. We find that 
there are five critical points where the eigenvalue structure changes. At a = ao = 
o/(2(A - a)), i? - S* = 0, with i? > and A > 0. The solutions of the quadratic 
equation A(a) = give ai and 03. At a2, -R = 0. At a4 = a/ {2{A —a)), R + S = 
with R < and A > 0. We arrange a,; (i = 0, 1,2,3,4) in increasing order, uji and 
UJ2 are complex conjugates for both a G (ai, 02) and a S (a2, 0:3). In our analysis, we 
only consider the case where a > (i.e. the firing rate is increasing with input). The 
case of a = with the general connection weight function was fully treated in PJ and 
is reevaluated in Sec. 13.21 Tables mi 13.21 and 13.31 enumerate all the possible forms of 
uji and UJ2- 



Table 3.1 
Eigenvalue chart when A> a 





El 


E2 


E3 


E4 


E5 


E6 




A > 
R<0<\R\ 
\R\ < S 


A > 
0<S <R 


A > 
i? < < 5" 
5'< \R\ 


A = 


A < 


A > 

R<0<\R\ 




real 


real 


imaginary 


= iU2 


= u!2 , complex 


= Vw. 


Ll>2 


imaginary 


real 


imaginary 


= (JJl 


= Wi, complex 





a 


(04, 00) 


(—00, ai) 


(q3, at) 


Qi, Qa 


(01,03) 


04 



Although both ao and 04 have the same expression, they do not co-exist. When 

A < a, an — ——, < and when A > a, aA — ——, > 0. For all values of cji 

2{A-a) 2{A -a) 

and UJ2, uu{x) and uiii{x) always have the form 13.1411 and (|3.15() respectively. 
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Table 3.2 
Eigenvalue chart when A < a. 





El 


E2 


E3 


E4 


E5 


E6 




A > 
< i? < 5" 


A > 
0<S <R 


A > 
i? < < S < |i?| 


A = 


A < 


A > 
0<R^S 




real 


real 


imaginary 


= UJ2 


complex 


= V2R 




imaginary 


real 


imaginary 


= t^l 


, complex 





a 


(-oo,ao) 


(ao,ai) 


(qs, oo) 








Table 3.3 
Eigenvalue chart when A = a. 




El 


E2 


E3 


E4 


E5 


E6 




A > 
0<R<S 


A > 
0<S <R 


A > 
i? < < 5" < 


A = 


A < 


R^S 







real 


imaginary 


= UJ2 


= ui2 ) complex 







real 


imaginary 


= aj2 


= tj* , complex 


a 


{-co, Qfi) 


(Q3, oo) 


ai, as 


(cn,a3) 



3.4. Solutions for real eigenvalues. 

3.4.1. Construction of single-pulse solutions. For a € {0,ai), both A and 
R are positive, so lui and lu2 are both real. Hence ui(x) and uii(x) have the following 
form: 

(3.32) ui{x) = C(e"i=^ + e'^^ + ^(e"^" + e""^") + ^(^^ ~ °)(^ ~ 

a — 2a{A — a) 

(3.33) Unix) = Se-"^ + Fe"^ 

When eigenvalues lui and W2 are real, C and Z) must also be real for real ui{x). 
Applying the the matching conditions H3.9|l - H3.13|l to 13.32f) and (|3.33|) yields 

(3.34) Be"""^ + Fe""^ = Ut 

(3.35) C(e'"i"^ + e-"i"^) + D(e"=^"^ + e""^"^) + (7o = 

(3.36) a;iC(e'"i"^ - e""!"^ ) + (.J2i3(e"=^"^ ^e""^"^) = -aFe"""^ - Fe""^ 

(3.37) a;?C(e"i"^ + e~"i"^) + a;iD(e"^"^ + e^"^"^) = a^Fe'""^ + Fe'"^ - 

2(aA- l)/3 

(3.38) a;fC(e"i"^ - e""!"^) + a;^F(e"^"^ - e""^"^) = (-a^ + 2aa{aA ~ l))Fe"''"^ + 

(-l + 2a(a^-l))Fe-"^ 

System (|3.34f) - (I3.38f) can be solved for the five unknowns C, D, E, F and Xt using 
Mathematica |74j . giving an explicit formula for ui{x) and uii{x). The single-pulse 
is then given by ui{x) on (—2:^,3:^), uii{x) on (xr,oo) and Miii(a;) on (—00,0:1,). 
For the parameter set (a, v4, a, /?, Ut) = (2.6,2.8,0.15,1,0.400273), the solution is 
{C,D,E,F,Xt) = (-0.8532,1.16865,2.94108,-0.89571,0.41902). Figure shows 
a graph of this single-pulse. The height ui(0) of the pulse is 0.77892. Its width is 
a;!^ = 0.41902. There also exists a second smaller and narrower single-pulse solution 
to (|3.34|I - H3.38|I for the same set of parameters (see Fig. 13. 7f) . The height and the 
width of this pulse are lii(O) = 0.6123 and x"^ — 0.2582 respectively. 



14 



Yixin Guo and Carson C. Chow 



u 




Fig. 3.6. Construction of large single-pulse \. A — 2.8, a = 2.6, a = 0.15, ut = 0.3. 
x'-r = 0.41092, height=u{0) = 0.77892. 



0.85 




Fig. 3.7. Large single-pulse 1 and small single-pulse s. A = 2.8, a = 2.6, a — 0.15, 
Mt = 0.3. (Left) Smgle-pulse 1; a;^ = 0.41092, height^u{0) = 0.77892. (Right) Smgle-pulse 
s: Xt = 0.2582, height^u{0) = 0.6123. 



When A = and R > {a — ai), there are repeating real eigenvalues: wi, ui, 
-LOi, —uji, where wi = ^/R. By the symmetry of ui{x), CI = £>! and C2 = _D2, so 



ui{x) from (|3.22|l can be written as 

(3.39) mix) = C(e"i^ + e-'^i^) + £ia;(e'^i^ + e""!^) + C/q. 

Applying matching conditions (|3.9(I - H3.13(I gives a similar system to (|3.34ll - (|3.38ll to 
which solutions can be found numerically. 

3.4.2. Finding solutions for real eigenvalues using the existence func- 
tion. In order to perform numerical continuation on the single-pulse solutions, it is 
more convenient to utilize the existence function $(a;) introduced by Amari 3 and 
calculated in Sec. 13.21 We compute it for the general case by first eliminating the 
threshold from system (|3. 34(1 - (13.38(1 to get an equivalent four equation system 



(3.40) C(e"i"^ + e' 



1+D{e 
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(3.41) c^iC(e"i"^ - e 

(3.42) w?C(e"i"^ + e 



(3.43) t^rC(e" 



)+uj2D{e' 
) + LolD{e- 



a 

a - 2a{A - a) 



(Ee~ 



+ e 



2XT 



) = a^Ee" 



+ Fe- 
^ - Fe-^ 



2{aA-l)(3 
') = {-a^ + 2aa{aA - l))Ee~'' 
(-1 + 2a{aA - l))Fe~'"^ 



+ 



Equations l|H.4()|l - l|3.44|l form a linear system in C, D, E, and F. To obtain an 
existence function <&(x), we construct coefficient vectors 



mi 



TO3 



( 



a-2a{A—a) 

a 



\ ( 

7714 = 



\ - 2aa(ay4 - 1) / 



a \ 

a—2a(A-a) \ 

1 

-1 

V 1 - 2a{aA-l) ) 



rriQ 



a~2a{A—a) \ 



-2(aA- l)/3 




Let DETxj.{a) — | mi m2 ms m4 | , where |.| is tlie determinant. For pa- 
rameters {a,A,a,P,UT) = (2.6,2.8,0.15,1,0.400273), the solution (C, D, E, F, x^,) = 
(-0.8532,1.16865, 2.94108,-0.89571,0.41902) with DET^^{a) = -243.2415568475 
is given by Mathematica. We use this solution as an initial guess to continue system 
(|3.34|l - (|3.38(l using AUTO while following DETx^{a) as a decreases to and then 
increases to ai. The recorded value of DETx^ shows that DETxj.{a) as a < ai. 
Therefore we can always solve the linear system H3.40ll - H3.44|l by Cramer's rule. The 
solutions for E and F given by 



E 



nil ^2 iTT-a "rrii 



mi 7712 fTT-i 



F 



mi m2 m3 mg 



mi m2 m3 m4 



are then substituted back into Uji{x) — E{x)e + F{x)e ^ to obtain the existence 
function 



(3.44) $(a;) Ee-'''' + Fe"^ 



mi m2 mo (ma — m4) 
mi m2 m3 m4 



Figure HTHl shows $(a;) H3.44|l . <i>(a::) approaches a limit as a; — > oo, but this limit is 
different from the limit of <f>(a:) in the Amari case {a = 0.) 
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Single-pulses of width xt are given by solutions of ^(xf) — u^- Since all four 
eigenvalues are real, there are no oscillations in ^(x) and so there are at most two 
pulse solutions. One is a small single-pulse, and the other is either a large single-pulse 
or a dimple-pulse depending on the threshold Ut- 




X 



x^x^ 1 x'' 2 3 



Fig. 3.8. Existence function ^{x) for a = 0.15, A = 2.8, a = 2.6. At ut = 0.400273, 
$(1) has a single-pulse 1 which has width x\p = 0.4109; the second single-pulse s is narrower 
with width x^ = 0.2582. At P, threshold Ut = 0.1489, u"(0) of the pulse at P is 0. 

3.4.3. Transition point P between single-pulses and dimple-pulses. The 

existence function <i>(x) gives a range of thresholds Uj, for which there exist two pulse 
solutions; a large pulse 1 (or dimple- pulse d) and a small pulse s, or only one small 
single-pulse solution. The x- value of the intersection of u-j. and is the width 

of a pulse. In figure x"^ is the width of s, and x]j. is the width of 1. At P, the 
curvature at the peak of the pulse solution is zero (i.e. u"(0) — 0) as seen in Fig. l3.1()l 
For this set of parameters, dimple-pulses appear if ut is between — 0.1489 and 
\mix^oo^{x) (See Fig. I3.8|l . Figure IX^ shows the continuation plot of u"(0); u"(0) 
crosses zero at u-^ — ■ 

3.4.4. Loss of existence for unbalanced synaptic connectivity. An exam- 
ination of the shape of $(a;) shows why single-pulses do not exist when excitation and 
inhibition are too much out of balance. When excitation dominates, A/a > 1. For 
fixed a, a and threshold Uj,, as A becomes larger, the existence function $(x) moves 
up and lim $(a;) becomes larger. The width of the large pulse 1 (or dimple-pulse) 

X — >oc 

increases fFig l3.1ll ^ When ^{x) is tangent to Uj- for large x (black curve in Fig lH.llI ) 
the width becomes 00 and the pulse no longer exist. The pulse 1 or d can be regained 
by increasing ut- However, for large enough A/a, $(a;) will become monotonic (see 
Fig. I3.12|l and only s exists. 

When A/ a < 1, inhibition dominates excitation in the network. For fixed a and a, 
$(x) diminishes as A is decreased (ratio A/a becomes smaller.) Eventually, the ratio 
is small enough to make $(a;) negative (see Fig. 13.1^1 . and for ut > 0, single-pulses 
no longer exist. Inputs to the neurons in the network never exceed threshold so the 
neurons cannot fire. 





Fig. 3.10. Example of P-pulse with a = 2.6, A = 2.8, a = 0.15, itj = 0.14838. The width 
of this pulse is = 1.27978 and u" {Q) = 0. 



0.6 - 



0.2 




1 



3 



Fig. 3.11. $(a;) with excitation dominating inhibition, a = 2.6, a = 0.05, ut ~ 0.400273, 
and different values of A: A = 3 (cyan); A — 3.5 (blue); A = 3.62 (black); A = 3.7 (red); 
A = 4.5 (green). When is tangential to threshold Ut for large x, the width of the large 

pulse is CO. 
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Fig. 3.12. c[>(x) mth excitation dominating inhibition: A = 29.6, a = 2.6, a = 0.03. 
There exists only pulse s, pulse \ or d do not exist. 

4> 




Fig. 3.13. "I>(a::) with inhibition dominating excitation, a — 2.6, a = 0.05, ut = 0.400273 
and different values of A: A = 2.5 (cyan); A — 2 (blue); A = 1.6 (red); A — 1.05 (black). 
There is neither pulse s nor pulse 1 for positive ut when A/ a is small enough (black color). 



3.5. Solutions for complex eigenvalues. As seen in Tables ITTl 13.21 and 13.31 

the eigenvalues loi and uj2 form a complex conjugate pair for ai < a < a^. Thus as 
long as ai < as, complex eigenvalues can be found for arbitrary a and A. Suppose 
uj-i^ = = p + iq. Then p = {R'^ + S'^)i cos9, p = (R^ + 5^)3 sinfl, where 9 = 

^ arctan "^^^ for a E (ai,Q!2) or 9 = ^ + ^ arctan "^^^^ for a £ (a2,a3). When 
a > as, A > 0, R < and S = < \R\. The real parts of uji and UJ2 are both zero 
and Wi = iqi, W2 — iq2, where qi = y/\R + S\ and q2 — \^\R — S\. 

3.5.1. Construction of a single-pulse with complex eigenvalues. To en- 
sure that ui{x) is real, C and D must be complex. Imposing symmetry, gives C = D* . 
Setting C = Ca + iCi implies D = Cr — iC,. Substituting C, D, uoi and aj2 into H3.22|l 
for ui{x) gives 

ui{x) — ACr cos(qx) cosh(pa;) — 4Cj sin(q2;) smh{px) + Uq. 

For simplicity, we relabel with C = AC^ and D = —4Ci. When wi and (jJ2 are both 
imaginary, we have 

ui{x) = C cos{qiXT) + D coa{q2XT) + Uq. 

Applying the matching conditions (|3.9|) - (|3.13|) . results in 5 algebraic equations with 
unknowns C, D, E, F and Xj, which can be solved numerically to obtain the explicit 



Existence and Stability of Standing Pulses in Neural Networks: I. Existence 19 

form of ui{x). The plots of pulses 1 and s are shown in Fig. 13.151 

When a — a^, R < 0, implying uji = uj2 = VR = W—R- Let u = \/—R G SR. 
Then 

ui{x) = Ci cos LUX + C2 sinwx + Dix coslox + D2X&mujx + ?7o. 
Since ui{x) = x), then C2 = -Di = leaving 

ui(x) — C cos ujx + Dx sin lux + Uo. 



U 



1.15 




X 



xl\ 2 



Fig. 3.14. Large smgle-pulse. A = 2.8, a = 2.6, a = 0.6178, ut = 0.3, = 0.58384, 
anrf u(0) = 1.0901. 




3.5.2. Finding solutions for complex eigenvalues using the existence 
function. The existence function ^{x) with complex lui and lu2 fFigs. ITTCI and lTTHIl 
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can be obtained using methods similar to those in Sec. 13.4.^ The main difference with 
the real case is that for complex eigenvalues can oscillate as seen in Fig. I3.1b1 

After the first local minimum between Pi and P2, ^{x) will approach a constant 
with decaying oscillations for increasing x. Additionally, if the threshold is between 
the first local minimum and the next local maximum, there exist more than two 
pulse solutions. Figure 13.171 shows an example where there is a small single-pulse 
and two dimple-pulses. There is never more than two coexisting pulses for real cui 
and ^2, which includes the Amari case, because the existence function does not 
oscillate. It is important to note that satisfying the existence condition $(a;) = ut is 
a necessary but not a sufficient condition for a pulse solution. It is possible to satisfy 
the matching conditions and not be a pulse. Thus although in principle, an infinite 
number of pulses could exist, in our experience, we find that most of the larger x 
solutions are not pulses. As will be shown in the accompanying paper pulse s is 
unstable and pulse 1 is stable. If there are three pulses, the largest third pulse which 
can be either a single pulse or a dimple pulse is unstable. 



0.2 



__s. 




/ 
















1 






Pj 


P2 



X 



1 



Fig. 3.16. Existence function a = 0.6178, A = 2.8, a = 2.6. At ut = 0.400273, 

<^{x) shows that there is a single-pulse 1 which is wider and has width xlp — 0.58385; the 
second single-pulse s is narrower and has width ~ 0.21317. ^4^ we increase Ut to the 
maximum of^{x), pulse s and 1 annihilate in a saddle-node bifurcation. At P, — 0.0767, 
= 1.454, u"{0) = 0. At b oth Pi and P2, ut = 0.063, u"{0) > 0, and the widths are 1.6 
and 1.9 respectively. See Fig. \3. 1 % 



Oscillations in also exist when the eigenvalues are pure imaginary. As before, 
more than two pulses, including dimple-pulses, can coexist (see Fig. 13.1^ depending 
on the threshold u^. Fig. 13.181 shows a special case of a dimple-pulse where the dimple 
minimum reaches the threshold. If the minimum drops below the threshold, the 
dimple-pulse breaks into two disjointed single-pulses or a double-pulse. This double- 
pulse is not a valid solution because it violates the assumptions of the equations from 
which the solution was derived. However, double pulses can exist and we show this 
using a separate formalism in Sec. |S1 

3.5.3. Blow-up for large a. For large enough a, the large pulse 1 blows up at 
a critical value a'' and does not exist for a > ao. The blow-up occurs in the regime 
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-0.45 




-0.45 



Fig. 3.17. Dimple-pulses with parameters A = 2.8, a — 2.6, a — 0.6178, Ut = 0.063. 
(Left) Dimple-pulse at Pi with — 1.6. (Right) Dimple-pulse at P2 with = 1.9. 



0.22 



0.06 








X 



Fig. 3.18. Existence function ^{x) with imaginary u>i = u)2 for A = 2.8, a = 2.6, a — 0:3, 
Mr = 0.0967003. The empty circles are small single-pulses. The solid circles are large single- 
pulses. The triangle is a dimple-pulse. Point P is where the dimple-pulse ffioure \^.iy\) breaks 
into a double-pulse. The x s are not valid solutions. 



where both uji and L1J2 are imaginary. Thus the height of pulse 1 is 

2(A- a){l3 - aur) 



(3.45) u{Q) = C + D + 
which can be expressed as 

(3.46) u(0) = 



a — 2a{A — a) 
(toi — 7712) tuq TO4 



TOl 7712 Tls 7714 
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Fig. 3.19. The transition from a dimple-pulse to a double-pulse at P withurp — 0.0967003, 
and u{0) = 0.0967003. 



where the coefficient factors mi, m2, ma, m4 for C, D, E, F and mo are defined in 
section 15.4.21 The blow-up occurs because the denominator of (|3.4t)|) goes to zero at 
a — while the numerator remains finite, sending the height m(0) of the large pulse 
to infinity. 

We can also see the loss of 1 in the existence function: 



$(a;) = Ee~ 



m2 mo (ma - rrii) 
TOi m2 m3 m4 



Figure 1^201 shows that when a > a", there is always the small single-pulse s but no 
large single-pulse 1. A third solution (the third intersection of Ut and $(a;)) could also 
exist but we have not examined this solution. As a increases, the height of 1 becomes 
very large but the width of the large pulse remains finite. This can be observed both 
from the existence function ^{x) and the continuation plot fFig l4.2ll in Sec. 01 




Fig. 3.20. Existence function $ for imaginary uj\^2 with A — 2.8, a = 2.6, Ut = 0.400273. 
(Left) a = 1.4. There is a single-pulse 1, and x\. = 0.8491539857774331, height^u{0) = 
146.2227855915919, which is big because a = 1.4 is close to a° where DET = 0. (Right) 
a = 1.41 > Q*^. Single-pulse 1 no longer exists. The vertical line in both pictures is where 
^(x) blows up. 
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4. Continuation in parameter space. One of our original goals was to under- 
stand how the shape of stationary pulses and their corresponding firing rates change 
as the parameters of synaptic connectivity and gain are changed. Here we give a 
global picture in the parameter space of mt, a, A, and a. A difhculty in this under- 
taking is that as the parameters are altered, the eigenvalue structure will make abrupt 
transitions. Hence, one must keep track of the eigenvalues and switch the form of the 
solutions when appropriate to construct a global picture. 

As we saw before, the small and large pulses arise out of a saddle-node bifurcation. 
This gives a minimal condition for when pulses can exist. In Figs. ETI and we 
show the large pulse 1 and the small pulse s arising from a saddle node bifurcation as 
a is increased for fixed a and A. We have set the threshold to 

<.ln A/(a-l) 

^ w{x)dx 
Jo 

so that the saddle node is exactly at a = 0. Note that at the saddle node bifurcation, 

Width 

1 r 




a 



Fig. 4.1. Width of single-pulse 1 (upper branch) and s (lower branch) for a = 2.6, 
A = 2.8, and Ut = 0.400273. For a £ [a*, a°), there are two single-pulses. For a £ [a^ , oo), 
there is only one single-pulse solution. At a = Q there is a saddle-node bifurcation where the 
large single-pulse 1 and the small single-pulse s arise. At oP , the large single-pulse 1 blows 
up. 



the pulse arises with nonzero height and width. 

We can now track the location of the saddle node and the maximum firing rate 
of the pulse at the saddle node in parameter space. We reduce the four dimensional 
parameter space by projecting to the space (a, a/ A, Ut)- The saddle-node location 
can be found by setting the threshold ut to the value of the first local maximum 
of $(a;). This gives an upper bound for allowable thresholds of the gain function to 
support a pulse solution. As long as ut is below this upper bound and positive, a 
single-pulse can exist. 

We first set A — 1.5 and vary the ratio a/ A and a to identify the saddle node 
threshold Uj,. We then calculate the maximum firing rate fmax of the single-pulse 
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6 r 




4 



2 



a 



a 



a 



a 



2 



Fig. 4.2. Height of single-pulse 1 (upper branch) and s (lower branch) for the same 



solution at this threshold which creates a two dimensional surface in the space of 
{a/A,a,UT)- We increment A in steps of 1 and create a set of surfaces. The surface 
plots of Uj, and fmax vs a/ A and a are shown in Figs. ^3] and ^31 Single-pulse 
solutions exist below a given surface (with Uj. > 0). Depending on the parameters, 
solutions could include one single-pulse s, a coexistence of single-pulses s and 1 (or a 
dimple-pulse d but in a smaller global range), or coexistence of more than two pulses. 

When excitation dominates inhibition (i.e. a/A is small) the single-pulse solution 
can blow up as mentioned in Sec. 13.5.31 We note that the crucial parameter for 
maintaining low firing rates is for inhibition to dominate excitation (i.e. a/ A to be 
large). Even for the balanced case of a — A, for gain slope a beyond unity, the firing 
rate rises dramatically. This is in correspondence with observations of numerical 
simulations ^§9^70 . 

5. Construction of double-pulse solutions. The neural network equation 
(11.11) can also support double-pulse or even multiple-pulse solutions [221 IH] ■ Double- 
pulses are solutions that have two disjoint open and finite intervals for which the 
synaptic input u{x) is above threshold. 

Definition 5.1. Double-pulse solution; A solution u{x) of \2.4^ is called a 
double-pulse or a 2-pulse if there are a;i > and X2 > such that 



exponentially fast as x ±oo. u and u' are bounded and continuous on R. u" , u'" and 
u"" are continuous everywhere for a; € except x = ±xi^2 o,nd bounded everywhere 



conditions as Fig. \4.1\ 




> Ut if X e {xi,X2) U { — X2, —Xl), Xl^2 > 
— Ut \i X — —X2,—Xi,Xi,X2 

< Ut otherwise 



with 



{u,u',u'\u"') -> (0,0,0,0) 
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Fig. 4.3. Surface plot of saddle node point in parameter space of (a/A, a, wt). The 
separate leaves correspond to values of A ranging from [*] to [*]. 



on R. u{x) is symmetric with u"{0) > 0; u(0) is the minimum between —Xi and Xi 

The approach to find and construct double-pulse solutions is similar to that for 
single- pulses. The connection function is H2.ll) and the gain function is (|2.2I) . Laing 
and Troy 021 found that double pulses can exist for the Amari case (a = 0). However, 
for the exponential connection function (|2.1|l . the double pulses are unstable. Coombes 
et at |15| found that double and higher number multiple-pulse solutions could exist 
in a network with a saturating sigmoidal gain function. As in the single-pulse case, a 
fourth order ODE on x € (— cx),oo) for double-pulses can be derived: 

(5.1) u"" ~ (a^ + l)u" + a?u = 

2a{A - a)f [u{x)] + 2{aA - 1) {/[^(a^a)] A^(a:) - f[uixi)]A[ix)} ~ 
2{aA - 1) {f'[u{xi)]u'{xi)Ai{x) + f'[u{xi)]u'{xi)A2{x)} - 
d'fHx)] 



2{aA-l)- 



dx'^ 



where 



Ai{x) — 6{x — xi) + 5{x + xi) 
A2{x) = 5{x - X2) + 5{x + X2) 
A'i{x) = S' {x — xi) — 5'{x + xi) 
A^(x) = 5'{x - X2) - 5'{x + X2) 



Double-pulses can be constructed using ODE (|5.1|) and the following set of matching 
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Fig. 4.4. Maximum point of firing rate of the single-pulse at the saddle node for the 
conditions as Fig. \4-^ 



conditions H5.2|l - H5.11|l at both xi and X2: 



(5.2) 


ui{xi) 


— Ut 






(5.3) 


uii{xi) 


— Ut 






(5.4) 


Ull{x2) 


= Urp 






(5.5) 


Ulll{x2) 


= Urp 






(5.6) 


u'j{xi) 


= u'liixi) 






(5.7) 


Uj{xi) 


= u'lAxi) + 




-i)/Wa;i)) 


(5.8) 


uT(xi) 




2{aA~ 


- 1)/'(m(xi))«'(xi) 


(5.9) 


u'n{x2) 


= u'llAx2) 






(5.10) 


U'liix2) 


= UHlix2) - 


- 2{aA 


-^)!{<X2)) 


(5.11) 


III 1 \ 

UIIKX2) 


III 1 \ 


- 2(aA 


- ^)f'{u{x2))u{x2) 


In the Amari 


case [a - 


= 0), for the 


same 


set of values of a, A, 



there are two coexisting double-pulse solutions. The existence conditions are 

w{xi - y)dy + / w{xi - y)dy = u^. 

-X2 J Xi 

/-Xi PX2 
^1x2 - y)dy + / w{x2 - y)dy = 
'X2 J X\ 

Both xy, — fi{xi,X2) and 2:3 = f2{xi,X2) form two dimensional surfaces in the three 
dimensional space (xi, 2:2, X3). The two surfaces intersect in a convex up space curve. 
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The intersection of this space curve with the plane 2:3 = Uj, are widths of candidate 
double pulse solutions. Since the surfaces do not oscillate for the Amari case there 
are only two intersection points. These two points give two double pulse solutions 
which are shown in Fig. 15.11 For the general a > case we, have found two coexisting 
double-pulses as shown in Fig 15.21 The coexistence of more than two double- pulses 
for a > remains an open problem. 

U 

0.8 r 




-0.3 L 



Fig. 5.1. Double-pulse for Amari case in which q = 0. A = 2.8, a = 2.6, a = 0, 
Ut = 0.26. For the large double-pulse(blue) : x\ — 0.279525, X2 ~ 1.20521. For the small 
double-pulse (black): xi = 0.49626, X2 = 0.766206. 



u 




-0.5 L 



Fig. 5.2. Two coexisting double-pulses. A — 2.8, a = 2.6, a = 0.98, Ut = 0.26. For 
the large double-pulse (blue): xi = 0.19266, X2 = 1.38376. For the small double-pulse (red): 
xi = 0.50582, X2 = 0.752788. 

In the accompanying paper |33j we confirm the Laing and Troy finding 42 that 
the double pulses in the Amari case are unstable. 
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6. Discussion. In this paper, we consider a population neural network model 
of the form with a nonsaturating gain function of the form (|1.2|l . We show 

the existence of stationary solutions that satisfy the equilibrium equation (|2.4|l by 
explicitly constructing single-pulse solutions for a specific synaptic connection function 
(|2.1() . The strategy was to convert the integral equation H2.4|) into a fourth order 
ordinary differential equation. A proof for the existence of a single-pulse of H2.4|l then 
becomes a proof for the existence of a homoclinic orbit of the ODE. Since the ODE 
has discontinuities across the threshold points, the ODE on the real line is reduced 
to three different linear ODEs on three regions separated by threshold points. The 
matching conditions for the solutions of the ODEs across the threshold points must 
satisfy a system of five equations. From this system, we are able to construct different 
single-pulse solutions. 

The eigenvalue structure of the linear ODEs is important for determining how 
many pulses exist. For real lui and 0^2, there are at most two pulses, the small 
single-pulse and the large one. Amari's case (a = 0) belongs to this regime. The 
large single-pulse can transform to a dimple-pulse depending on the threshold value 
fFig. 13.101 1 If the eigenvalues are complex, there could be a small single-pulse and 
two large pulses with different widths. Depending on the threshold, these two large 
pulses could be dimple-pulses (Fig. 13.171 ) There also exists a transition point where 
a dimple-pulse breaks into a double-pulse. 

There are three ways that the large pulse can disappear. First, for fixed gain a 
and threshold Ut, if the excitation is too strong, i.e. ratio A/a is large, the width 
of the large pulse becomes wider and eventually loses existence. Second, with fixed 
excitation, i.e., fixed a and A, if the gain is too large, i.e., a is large, the large pulse 
increases in height and blows up at a finite value of a. Third, with too little excitation 
or gain, the stable large pulse coalesces with the unstable small pulse and vanishes in 
a saddle node bifurcation. 

The pulses are a proposed mechanism of persistent neuronal activity observed 
during working memory. Therefore, it is crucial to access their stability. In the 
accompanying paper, we show that the large pulse is stable and the small pulse is 
unstable. We also show that dimple-pulses can be stable. We show that single- 
pulses can exist for a wide variety of gain and connection functions. However, for 
single-pulses to exist with low firing rates we require the gain to not be too large and 
inhibition to dominate excitation. This suggests that the cortex could be dominated 
by inhibition. 
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